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Abstract — We propose a framework for the derivation and 
evaluation of distributed iterative algorithms for receiver coop- 
eration in interference-limited wireless systems. Our approach 
views the processing within and collaboration between receivers 
as the solution to an inference problem in the probabilistic model 
of the whole system. The probabilistic model is formulated to 
explicitly incorporate the receivers' ability to share information 
of a predefined type. We employ a recently proposed unified 
message-passing tool to infer the variables of interest in the factor 
graph representation of the probabilistic model. The exchange 
of information between receivers arises in the form of passing 
messages along some specific edges of the factor graph; the 
rate of updating and passing these messages determines the 
communication overhead associated with cooperation. Simulation 
results illustrate the high performance of the proposed algorithm 
even with a low number of message exchanges between receivers. 



I. Introduction 

Cooperation in interference-limited wireless networks has 
the potential to significantly improve the system perfor- 
mance Q). Additionally, variational techniques for Bayesian 
inference [2| are proven extremely useful for the design of 
iterative receiver architectures in non-cooperative scenarios. 
Hence, using such inference methods to design iterative algo- 
rithms for receiver cooperation could be beneficial. 

Algorithms based on belief propagation (BP) are proposed 
in (3), (4) for distributed decoding in the uplink of cellu- 
lar networks with base-station cooperation, assuming simple 
network models, uncoded transmissions and perfect channel 
knowledge at the receivers; it is shown that the performance 
of optimal joint decoding can be achieved with decentralized 
algorithms. In Q, JSJ, the authors discuss strategies for base- 
station cooperation and study the effect of quantizing the 
exchanged values, still assuming perfect channel knowledge. 

In this paper, we study cooperative receiver processing 
in an interference channel and formulate it as probabilistic 
inference in factor graphs. We state a probabilistic model that 
explicitly incorporates the ability of the receivers to exchange 
a certain type of information. To infer the information bits, we 
apply a recently proposed inference framework that combines 
BP and the mean-field (MF) approximation Q. We obtain 
a distributed iterative algorithm within which all receivers 
iteratively perform channel and noise precision estimation, 
detection and decoding, and also pass messages along the 
edges in the factor graph that connect them. The rate of 
updating and passing these messages determines the amount 
of communication over the cooperation links. 



Notation: The relative complement of {i} in a set I is 
written as X \ i. The set {i 6 N | 1 < i < n] is denoted 
by [1 : n]. Boldface lowercase and uppercase letters are used 
to represent vectors and matrices, respectively; superscripts 
(•) T and (-) H denote transposition and Hermitian transposition, 
respectively. The Hadamard product of two vectors is denoted 
by 0. The probability density function (pdf) of a multivariate 
complex Gaussian distribution with mean fi and covariance 
matrix X is denoted by CN(-;/x,S); the pdf of a Gamma 
distribution with scale a and rate b is denoted by Ga(-;a, b). 
We write f(x) oc g{x) when f(x) — cg(x) for some positive 
constant c. The Dirac delta function is denoted by S(-). Finally, 
E[ ] stands for the expectation of a random variable. 

II. System Model 

We consider a system with K parallel point-to-point links 
where each user sends information to its corresponding re- 
ceiver and interferes with the others by doing so. To decode 
the desired messages, the receivers are able to cooperate by 
exchanging information over dedicated error- free links. 

A message sent by user k is represented by a vector 
Ufc G {0, l} Ik of Ik information bits and is conveyed by 
sending N data and L pilot channel symbols having the sets 
of indices V c [1 : N + L] and V C [1 : N+L], respectively, 
such that PUP = [1 : N + L] and PnP = 0; the 
sets V and V are identical for all K users. The bits in 
are encoded and interleaved into a vector Ck G {0, l} Ch of 
Cfe = MkN bits which are then mapped to data symbols 
x° = (xk(i) | i G T>) T G S£?, where Sk is a (user specific) 
discrete complex modulation alphabet of size 2 Mk . Symbols 
x° are multiplexed with pilot symbols = (xk(j) | j G 7- , ) T 
which are randomly drawn from a QPSK modulation alphabet. 

The users synchronously transmit their aggregate vectors 
of channel symbols x& = (xk(i) | i G [1 : N + L]) T over an 
interference channel with input-output relationship 



y; = 



ke[l:K 



hifcOxfe+w/, VZ €[!:#]. 



(1) 



The vector y/ = (yi(i) \ i G [1 : N + L\) contains the signal 
received by receiver I, hik — (hik(i) \ i £ [1 : N + L]) T is the 
vector of complex weights of the channel between transmitter 
k and receiver I, and w; = (wi(i) \ i G [1 : N + L]) T contains 
the samples of additive noise at receiver I with pdf p(w;) = 
CN (w;; 0, 7 / ~ 1 lAT + i) for some positive precision 7j. For all 
I £ [1 : if], we define the signal-to-noise ratio (SNR) and 



interference-to-noise ratio (INR) at receiver I as 

SNR , =,,,«, INR,=- n E ^' E " |h "- 1121 . 

N + L ' N + L 

III. The Combined BP-MF Inference Framework 

In this section, we consider a generic probabilistic model 
and briefly describe the unified message-passing algorithm that 
combines the BP and MF approaches Q. 

Let p(z) be an arbitrary pdf of a random vector z = 
(zi | i £ X) T which factorizes as 

p(*) = n /-w = n /«w n ^ ^ 

where z a is the vector of all variables z; that are arguments of 
the function f a for all a G A. We have grouped the factors into 
two sets that partition A: Amf f~) .Abp = and A M f U -4bp = 
A. The factorization in © can be visualized by means of 
a factor graph [8|. We define J\f(a) C X to be the set of 
indices of all variables Zi that are arguments of function f a ; 
similarly, J\f(i) C A denotes the set of indices of all functions 
f a that have variable z.- L as an argument. The parts of the graph 

that correspond to U a eA BP /«0a) and to Ilae.4„ F are 
referred to as "BP part" and "MF part", respectively. 

The combined BP-MF inference algorithm approximates the 
marginals p(zi) = J p(z) Ylj eX \i dzj, i e X, by auxiliary pdfs 
bi(zi) called beliefs. They are computed as |7| 

k(z i ) = u k J] m^(zi) J] ( 3 ) 

ce^ B pnA/"(i) ceAiFnA/^i) 

with 

ml^i(z t )=u a J[ dZj Uj^aiZj) / (z ), 
V a G -4 B p, « eJV(a), 



A. Probabilistic system model 

The probabilistic system function can be obtained by fac- 
torizing the joint pdf of all unknown variables in the signal 
model. Collecting the unknown variables in vector v, we have: 



p(v) oc J| 

Ze[l:-ff] 



p(y;|hn, . . . ,h zif ,x 1; . . . ,x K , 7;)p(7 



n 



ke[l:K] 



(5) 



n p( x fci c fc)p( c fci u fc)p( u fc)- 



To include in the probabilistic model the ability of the 
different receivers to exchange information of a certain type, 
we define an augmented pdf. Depending on the type of shared 
information, several cooperative strategies can be devised: the 
receivers could exchange their current local knowledge about 
the modulated data symbols x°, or coded and interleaved 
bits Cfe, or information bits u^. We focus on the case in 
which the receivers share information on c/jQ- To construct the 
augmented pdf for this cooperation scenario, we replace each 
vector variable x,r. and with K "alias" variables x^.; = Xfe 
and Cfc ; = Cfe, k, I G [1 : K], which are constrained to 
be equal to the corresponding original variable. Keeping in 
mind that receiver I is interested in decoding message u;, the 
factorization of the augmented pdf reads 



P (v')oc n 



le\l:K] 



p(y;|ha, . . .,hur,xPj, . . . ,x^,,7;) 



pin) n (p( h ik)p(xk,i\ c k,i))p{ci,i\ui) (6) 

k£[l:K] 

Yl p{n{i)) Yl p( c k,i\ c k,k) 

ie[l:/i] ke[UK]\l 

where v' denotes the vector of all unknown variables in (|6j, 
including the alias variables. Next, we denote, define and 
group in sets the factors in (|6j. For all I G [1 : K], the factors 



MF , N ( f tt / , s\ / 0i (ha,...,x° ; ,...,7() =p(yi|hji,..-,x?,i,. 

i> a ^i{Zi) = exp / [[ dzj nj^aizjjln f a {z a ) , / \ 

V J = n CN Uw; E M^w^r 1 

V a G v4mf,« G M(a), iecu? V fee[i:Jfl / 



,7zJ 



V a G *4mf, i G M(a), 

ce^BpnA^(i)\a ce^WrWW 

V i e jV(a),a G .A, 

(4) 

where w,; and cj a are constants that ensure normalized beliefs. 

IV. Distributed Inference Algorithm 

In this section, we state a probabilistic formulation of 
cooperative receiver processing and use the combined BP-MF 
framework to obtain the message updates in the corresponding 
factor graph; finally, we define a parametric iterative algorithm 
for distributed receiver processing. 



e[i-.K] 

incorporate the observation vector y; and they form the set Aq\ 
the factors /n, (7;) = p{ji) are the prior pdfs of the parameters 
7i and they form the set „4 N ; the factors f H[k (h ifc ) = p(h ife ) = 
CN (hik] h^., H^}, k G [1 : K], represent the prior pdfs of 
the vectors and they form the set Ah', denoting by c\ ; the 
subvector of Ck,i containing the bits mapped on Xk,i(i) and by 
Aik(-) the mapping function, for all k, the factors 



,/.v 



P{ x k,i\ c k,i) 



i£T> 

'The other alternatives can be implemented with straightforward modifica- 
tions to the model presented in this section. 



account for the modulation mapping and they form the set 
Am\ the factors f Cl (cj,j, uj) = p(c u |u/) stand for the coding 
and interleaving operations performed at transmitter I and they 
form the set Ac; the factors /uf (m)) — p{ui(m)), m e 
[1 : Ii] are the uniform prior probability mass functions of 
the information bits and they form the set A\j', finally, for all 
k 7^ I, the factors 

fai (Cfc.z, C fc ,fc) = p(c fc ,; \c k ,k) 

= J] Cfc,fc(n)) (7) 

n£[l:C fe ] 

constrain the alias variables c^;, I £ [1 : if] to be equal, 
and they form the set Ae- Note that, due to these additional 
constraints, marginalizing (0 over all alias variables Ck.i, I ^ 
k leads to the original probabilistic model (|5j- 

The factorization in (O can be visualized in a factor graph, 
which is partially depicted in Fig.Q] The graphs corresponding 
to the channel codes and interleavers are not given explicitly, 
their structures being captured by /q . We coin "receiver I" the 
subgraph containing the factor nodes / H[1 , . . . ,fa K , fa, fa, 
/m u ,- • • , fu K ,i, fa, /u,,n • • • , fa, h and the variable nodes 
connected to them. The factor nodes /e,,. and /e^, model the 
cooperative link between receivers I and 

We can now recast the problem of cooperative receiver 
processing as an inference problem on the augmented proba- 
bilistic model ||6): receiver I needs to infer the beliefs of the 
information bits in u; using the observation vector yi and prior 
knowledge, i.e., the pilot symbols of all users^ and their set 
of indices V, the channel statistics, the modulation mappings 
of all users, the structure of the channel code and interleaver 
of user I, and the external information provided by the other 
receivers. The inference problem is solved by applying the 
method described in Section [TTlJ which leads to iteratively 
passing messages in the factor graph. We can control the 
communication overhead between receivers by adjusting the 
rate of passing messages through nodes f% lk and fs hl . 

B. Message computations 

To make the connection with the arbitrary model in Sec- 
tion |nil we define A and I to be the sets of all factors and 
variables, respectively, introduced in the previous subsectioifl 
We choose to split A into the following two sets that yield the 
"MF part" and the "BP part": 

Amf = A H U Ao U A n ; A B p — Am U Ac U Au U Ae- (8) 

In the following, we use (O to derive messages in our setup, 
focusing on their final expressions. More detailed message 
computations using the combined BP-MF method can be 
found in [7| and |9| for non-cooperative scenarios. 

First, for all k, I € [1 : K) we define the statistics 



Since the pseudo-random pilot sequences can be generated deterministi- 
cally based on some information available to all receivers, each receiver is 
able to reconstruct all the pilot symbols without the need of exchanging them. 

3 With a slight abuse of notation, from this point on we use the names of 
functions and variables as indices in the sets A and X, respectively. 




Fig. 1. Factor graph representation of the pdf factorization in ^6): receivers 
I and k are depicted together with the connections between them. For all 
1 £ [1 : K], the bits c; ; in receiver I are connected to the bits C; . in all 
other receivers, while the bits Cfc k ^ I, are only connected to the bits cj. k 
in receiver k. 



Cfc,i(i) 



for i £ T> and we set Xk,i{i) = Xk,i{i) and <r^ ,~ = 0, 
for i e V. We also definefl 7; = / n 7i ^ /0; (7;) 7; d7;, h ;fe = 

S hifc = J n hlk ^ f0i (h Jk ) (h ;fc - hik){hik ~ h lk ) H dh ik , 

and we denote by o^ lh u\ the (i,i)th entry of Sh ifc - 
Channel estimation: Using we obtain the messages 

mf^ h Jh lk )cx J] CN(^(i);^(i),4 feW ) 

ievuv (9) 

cxCN (h, fc ;h? fc ,5£ |fc ), 
for all k, /, where ^h lk i s a diagonal covariance matrix and 

I*,lW 1 K '' V \ k'^k J 

a- 2 fcW = 7 (< i(i) + \xkM 2 ) > V^DUP. 

We have ^. hiJ ,(h; ft ) = / H!fc (h ;i; ); so, using ©, we 
obtain 

"h ; ^/ 0i (M = CN (h lk ; hik, S hifc ) , (10) 
k, I e [1 : if], with 



Hk 



~ 1 + (K lk r 1 



4 The defined quantities are the parameters determining the corresponding 
beliefs, because /o, is in the MF part and therefore the beliefs are equal to 



the "n" messages (see (3)>E}). 



Noise precision estimation: Using 0, we obtain 

w/ ^ 7i (7i) oc 7;°° exp(-d 7i) cx Ga(7/, a + 1, d ), (11) 
I £ [1 : if], with a = N + L and 



^ E 



yi(0 - E hik{i)x k ,i{i) 



El 2 



E~ 2 



%»wI*m(*)I' 



E^mW 



ft-!fc(i)l 



We select the conjugate prior pdf f^,{ji) — Ga(7z, a p , d p ), 
I £ [1 : K}. Using 0, we obtain 



J 7i ^/„ (7;) = Ga(7;, a p + a , d p + d ). 



(12) 



Setting the prior pdfs to be non-informative, i.e., a p = d p = 0, 
we obtain the estimate ji = a /d , I £ [1 : K}. 
Symbol detection: Using 0, we obtain 

with 

*L(*) = ^ ;(///(') 



x lA i ) 



7i(< fcW + I^W| 2 



k'^k j 

Vi G P. 



Assume that in the BP part of the graph we have obtained 



iGC \s£S k 



(14) 

where ,(i)(s) is the extrinsic value of Xk,i(i) for s £ Sk- 
According to 0, the discrete messages (APP values) 

H 1 ^J^> m K 1 X,,^>U^ (15) 

«II E Ac M (i)(s)CN ^s;x^(i),^o ;(i) J 8{x kil {i) - s) 

i€Vs£S k 

are sent to the MF part, while n x D ( ( x fc i ) K 



,MF 



, D (x° ; ) are sent to the BP part as extrinsic values. 



(De)mapping, decoding, information exchange: These oper- 
ations are obtained using 0, which due to reduce to the 
BP computation rules. Messages from and to binary variable 
nodes are of the form 95(v — 0) + (1 — 6)S(v — 1), with 
6 £ [0,1]. Computing -+ Cktl (n)( c f°A n )) is equivalent 

to MAP demapping, k,l £ [1 : K], n £ [1 : C k ]- 
The messages n Ul{m) ^ }ci {ui(m)) = f U[m (ui(m)), Vm £ 
[1 : and n Ci i( „)^ /Ci (c M (n)) oc mj£ ^ , (n) (q,i(«)) x 

n 



* '"A, 



«i,i(n) 



(cj i(ji)) represent the input values to the 
de-interleaving and decoding BP operations which output 

Due to the equality constraints 



/c,->«(( m ) 



and m? p 



/c,->-Ci,i(n) 



0, messages pass transparently through the factor nodes /e !S ., 
2, fc £ [1 : if]. Therefore, the following messages are received 
by receiver k from receiver I, k, I £ [1 : If] and n £ [1 : Cfc]: 

TO /E P fci ->c fc , fc (n)(cfe,feH) oc m% . Cfeii(n) (c fe , fe (n)), (16) 



Vc,-vci,i(n) 



The messages 

n c kll (n)^fM k<l ( C M (»)) « m| p fc; _, Cfe _ i(n) ( Cfc ,i (n)), 

x Il m / E I ! fc ^, ! («)( c '^")) 

fc 

k, I £ [1 : if], n 6 [1 : Cfc], are used in © to obtain the soft 
mapping updates (fl4l . 

C. Algorithm outline 

We define the cooperative processing algorithm by speci- 
fying the order in which the messages in Section IIV-BI are 
computed and passed in the factor graph. The algorithm 
consists of three main stages: 

1) Initialization: Receiver I obtains initial estimates of its 
variables. First, estimates of hki(i) with i £ V are obtained 
for all k by using an iterative estimator based on the signals 
at pilot positions only, similar to the one described in ||9] 
Sec.V.A]. Specifically, we restrict ((9), ([T0]l, CD} to include 
only subvectors and submatrices corresponding to pilot indices 
and we initialize 7; = 1 and hki(i) = 0, i £ V. We compute 
and ( fTOt successively for all k, and then (fTTb and ( TT2l ; 
repeat this process A; n times. The initial estimates of hki are 
obtained by applying (TlOb for whole vectors and matrices, with 



0, i £ V. Then, we set Xk,i(i) = and 
at = 1, i £ T>. Estimation of 7; is performed using 
(II It and (TT2l . followed by symbol detection ( fT3l l. applied 
successively for all fc; this process is repeated A^et times. 
Finally, soft demapping and decoding are performed in the 



>Ci,fe(n) 



initialized to 



c; i(n) fr° m a H receivers k I; then, it computes and 
c; fc(n) gi ven ^ t0 a ^ receivers k ^ I. 



BP part, with m?/ . , and m? p 
have equal bit weights. 

2) Information exchange: Receiver / sends m^J _^ Cfc , n % 
given by (fTol l to receiver fc and simultaneously receives 

sends m? 

3) Local iteration: Receiver I computes ( fl8t . followed by 
(fTTb and (fT5l l. for all fc. Next, hfcj, fc £ [1 : iv], are successively 
estimated using and (fTOt . and 7; is estimated using (fT2l . 
Then, (TT3T > is successively computed for all fc, repeating this 
process Ad e t times. Finally, soft demapping and decoding are 
performed in the BP part. 

To define the distributed iterative algorithm, we use three 
parameters: N- a describes the total number of receiver it- 
erations, including the Initialization stage as first iteration; 
A ex £ [0 : Ai t — 1] denotes the number of Information exchange 
stages; for N ex > 0, the vector t E = (^(e) | e G [1 : A ex ]) G 
[1 : Ai t — 1] with strictly increasing elements contains the 
iteration indices after which an Information exchange stage 
takes place. For A ex = we set 4e = 0. 

Algorithm 1: The steps of the algorithm are: 

1) Initialization for all I £ [1 : K); Set t = 1 and e = 1; 

2) If t > N it then go to step 5); 




SNR (dB) 

Fig. 2. BER vs. SNR performance of the distributed iterative algorithm. 

3) If tfc(e) = t then Information exchange V7; e = e + 1; 

4) Local iteration for all I; t = t + 1; go to step 2); 

5) Take hard decisions using the beliefs 

b V,, m ( u l( m )) = W/,mTl^_ Mll(m) (Ui(m))/u 1)m ('Mi( m ))' 

V. Simulation Results 

We consider an OFDM system consisting of K — 2 links 
with symmetric channel powers, same noise levels at the 
receivers, and strong interference, i.e. SNRi = SNR2 = 
INRi = INR 2 = SNR. The detailed assumptions are listed 
in Table [I] The performance of Algorithm Q] is evaluated 
through Monte-Carlo simulations. The BER dependence on 
SNR is illustrated in Fig. [2] while the BER convergence is 
given in Fig. [3] Receiver collaboration provides a significantly 
improved performance compared to a non-cooperative setting 
(N ex = 0). When N ex = 1, an error-floor occurs at BER 
fa 3 • 10~ 4 , but the cooperation scheme with only two ex- 
changes almost achieves the performance of "full" cooperation 
(Aex = 19); the improvement brought by the second exchange 
is clearly visible in Fig. [3] All schemes need about 5-6 receiver 
iterations to converge. The benefits of cooperation are also 
observed in the improved channel weights and noise precision 
estimation (results are not presented here), which of course 
lead to improved detection and decoding, and vice-versa. 



TABLE I 
Simulation parameters 



Parameters of the OFDM system 


Value 


Number of users 

Subcarrier spacing 

Number of active subcarriers 

Number of pilot symbols 

Modulation scheme for data symbols 

Convolutional code (of both users) 

Multipath channel model 


K = 2 
15 kHz 

N + L = 100 
L = 17 evenly spaced pilots 
QPSK (Mi = M 2 = 2) 
R = 1/3, (133, 171, 165) 8 
3GPP ETU 


Parameters of the algorithm 


Value 


Number of receiver iterations 
Number of exchanges 
Exchange indices 
Number of sub-iterations 


N k = 20 

TVex e {0, 1, 2, 19} 

t E g {0, 1,(1, 5), (1,..., 19)} 

AT in = 10, JV dcl = 5 



VI. Conclusions 

We proposed a message-passing design of a distributed 
algorithm for receiver cooperation in interference-limited wire- 




5 10 15 20 

t 

Fig. 3. BER vs. iteration number at SNR = 8 dB. 

less systems. Capitalizing on a unified inference method that 
combines BP and the MF approximation, we obtained an 
iterative algorithm that jointly performs estimation of channel 
weights and noise powers, detection, decoding in each re- 
ceiver and information sharing between receivers. Simulation 
results showed a remarkable improvement compared to a 
non-cooperative system, even with 1-2 exchanges between 
receivers; as expected, a trade-off between performance and 
amount of shared information could be observed. 

In general, our approach provides several degrees of free- 
dom in the design of distributed algorithms, such as the type of 
shared information and the parameters of the algorithm (num- 
ber of receiver iterations, rate and schedule of information 
exchange). The proposed approach can be extended to other 
cooperation setups and it can accommodate the exchange of 
quantized values - the quantization resolution thus becoming 
another implementation choice - by quantizing the parameters 
of the messages passed between the receivers. 
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